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Abstract 

The length is{w) of the longest increasing subsequence of 
a permutation w in the symmetric group &n has been the 
object of much investigation. We develop comparable results 
for the length as{w) of the longest alternating subsequence of 
w, where a sequence a, b,c,d,... is alternating if a > 6 < c > 
d < ■ ■ ■ . For instance, the expected value (mean) of as{w) for 
w £ &n is exactly {in + l)/6 if n > 2. 



1 Introduction. 

Let &n denote the symmetric group of permutations of 1,2, ... ,n, 
and let w = Wi---Wn G ©„. An increasing subsequence of w of 
length /c is a subsequence Wi^ ■ ■ ■ Wi^. satisfying 

Wi^ < < ■ ■ ■ < Wi^. 

There has been much recent work on the length isn(w) of the longest 
increasing subsequence of a permutation w G ©„. A highlight is the 
asymptotic determination of the expectation E{n) of is„ by Logan- 
Shepp [TT] and Vershik-Kerov [T^, viz., 

E{n) := — ^ iSn{w) ~ n ^ oo. (1) 
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Baik, Deift and Johansson jS] obtained a vast strengthening of this 
result, viz., the hmiting distribution of is„(w) as n ^ oo. Namely, 
for w chosen uniformly from (3„ we have 

where F(t) is the Tracy- Widom distribution. The proof uses a result 
of Gessel that gives a generating function for the quantity 

Uk{n) = i^{w e &n : is(ti') < k}. 

Namely, define 

Uk{x) = y^Uk{n) — , k>l 

n>0 

Ii{2x) = V — -, i G Z. 

n>0 ^ ' 

The function is the hyperbolic Bessel function of the first kind of 
order i. Note that Ii{2x) = /_j(2x). Gessel then showed that 

Uk{x) = det (/i_,(2a;))f 

In this paper we will develop an analogous theory for alternating 
subsequences, i.e., subsequences Wi-^ ■ ■ -Wi^ of w satisfying 

Note that according to our definition, an alternating sequence a, b,c, . . 
(of length at least two) must begin with a descent a > b. Let 
as{w) = as„(w) denote the length (number of terms) of the longest 
alternating subsequence of w G (5„, and let 

ak{n) = i^{w G &n '■ as(w) = k}. 

For instance, ai{w) = 1, corresponding to the permutation 12- ■ - tt,, 
while an{n) is the total number of alternating permutations in (3„. 
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This number is customarily denoted En. A celebrated result of Andre 
[Ulini §3.16] states that 



E3j 
-En— = secx + tanx. (3) 



n>0 



The numbers were first considered by Euler (using Q as their 
definition) and are known as Euler numbers. Because of (jS)) i?2n is 
also known as a secant number and £^2^-1 as a tangent number. 
Define 

h{n) = i^{w e &n ■ as(w) < k} 

= ai{n) + a2{n) -\ hafc(^), (4) 

so for instance bk{n) = n\ for k > n. Also define the generating 
functions 



A{x,t)= J2 Mn)t'^ (5) 

k,n>0 

B{x,t)= V bk{n)t''^. 



fc,n>0 



Our main result (Theorem 12 .31) is the formulas 

_ 1 + p + 2te^- + (1 - p)e^^- 

A(x,t) = (1 -t)5(x,t), 

where p = Vl — t^. 

As a consequence of these formulas we obtain explicit formulas for 
afc(n) and bk{n): 

r=fc (mod 2) 

afc(?^) = &fc(n) - bk-i{n). 
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We also obtain from equation (jUI) formulas for the factorial moments 



n. 



— as(w)(as(w) — 1) ■ • ■ (as(w) — A; + 1). 



For instance, the mean z/i(n) and variance var(as„) = z/2(n) + z/i(n) 
z/i(n)^ are given by 



o 

/ , 8 13 
var(as„) = " ^ > 4. 



(7) 



The limiting distribution of as^ (the analogue of equation IS))) was 
obtained independently by Pemantle and Widom, as discussed at the 
end of Section El Rather than the Tracy- Widom distribution as in 
(121), this time we obtain a Gaussian distribution. 

Note. We can give an alternative description of &fc(n) in terms 
of pattern avoidance. If v = ViV2- • -ffe G &k, then we say that a 
permutation w = W1W2 ■ ■ - Wn & &n avoids f if w has no subsequence 
Wi^Wi^ ■ ■ ■ Wi^ whose terms are in the same relative order as f [HI 
Ch. 4.5] [m §7]. If X C &k, then we say that w e &n avoids X 
if w avoids all v & X. Now note that &a;-i(^) is the number of 
permutations w G ©„ that avoid all Ek alternating permutations in 
&k- 

After seeing the first draft of this paper Miklos Bona pointed out 
that the statistic be expressed very simply in terms of a 

previously considered statistic on ©„, viz., the number of alternat- 
ing runs. Hence our results can also be deduced from known re- 
sults on alternating runs. This development is discussed further in 
Section 01 In particular, it follows from that the polynomials 
Tn{t) = ^k^k{n)t^ have interlacing real zeros. This result can be 
used to give a third proof (in addition to the proofs of Pemantle and 
Widom) that the limiting distribution of Gaussian. 
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2 The main generating function. 



The key result that allows us to obtain explicit formulas is the fol- 
lowing lemma. 

Lemma 2.1. Let w G &n- Then there is an alternating subsequence 
of w of maximum length that contains n. 

Proof. Let ai > 02 < ■ ■ ■ be an alternating subsequence of w of 
maximum length k = as{w), and suppose that n is not a term of 
this subsequence. If n precedes ai in w, then we can replace ai by n 
and obtain an alternating subsequence of length k containing n. If n 
appears between and Oj+i in w, then we can similarly replace the 
larger of and Oj+i by n. Finally, suppose that n appears to the 
right of Ofc. If k is even that we can append n to the end of the subse- 
quence to obtain a longer alternating subsequence, contradicting the 
definition of k. But if k is odd, then we can replace by n, again 
obtaining an alternating subsequence of length k containing n. □ 

We can use Lemma f2. II to obtain a recurrence for ak{n), beginning 
with the initial condition ao(0) = 1. 

Lemma 2.2. Let 1 < k < n + 1. Then 

afc(n + l) = ^Pj {a2r{j) +a2r+iij))as{n - j). (8) 

j=0 V-^/ 2r+s=k-l 
r,s>0 

Proof. We can choose a permutation w = ai ■ ■ ■ a„+i G ©n+i such 
that as(w) = as follows. First choose < j < n such that a^+i = 
n + 1. Then choose in (") ways the set {ai, . . . ,aj}. For s > 
we can choose in as{n — j) ways a permutation w' = aj^2 " ■ 'O-n+i 
satisfying as(w') = s. Next we choose a permutation w" = ai - ■ ■ aj 
such that the longest even length of an alternating subsequence of 
w" is 2r = k — 1 — s. We can choose w" to satisfy either as{w") = 2r 
or as{w") = 2r + 1. The concatenation w = w"{n + l)w' G ©„+i will 
then satisfy a,s{w) = k, and conversely all such w arise in this way. 
Hence equation (jHl) follows. □ 
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Now write 

ak{n)—r. 

n I 



n>0 



For instance, Fq{x) = 1 and Fi{x) = e^ — 1. Multiplying (jHl) by a;"/n! 
and summing on n > gives 

F^(x)= Yl {F^r{x)+F^r^,{x))F,{x). (9) 

2r+s=A;-l 

Note that 

A{x,t) = Y,Fk{x)t\ 

k>0 

where A[x, t) is defined by (0). Since A; — 1 — s is even in 0, we need 
to work with the even part Ae{x^t) and odd part Ao{x,t) of A{x^t), 
defined by 



fc>0 

1 



2k 



^{A{x,t) + A{x,-t)) 



Ao{x,t) = ^F2A:+l(x)t 



2k+l 



(10) 



fc>0 

= ^{A{x,t)-A{x,-t)). 
Multiply equation Q by t'' and sum on A; > 0. We obtain 

^^^^ = tA,{x, t)A{x, t) + Ao{x, t)A{x, t). (11) 
Substituting —t for t yields 

dA{x, -t) ^ t)A{x, -t) - Ao{x, t)A{x, -t). (12) 

ox 

Adding and subtracting equations (fTT|) and (fT^ gives the following 
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system of differential equations for = Ae{x,t) and Ao = Ao{x,t): 



' - tA.Ao + Al (13) 



dx 

tAi + AeAo. (14) 



dx 

Tlius we need to solve this system of equations in order to find 
A{x, t) = Ae{x, t) + Ao{x, t). 

Theorem 2.3. We have 

_ l+P + 2te^- + (l-p)e^^- 

A{x,t) = {l-t)B{x,t) (16) 
l+p + 2teP^ + {l-p)e^P- 

where p = Vl — • 

Proof. We can simply verify that the stated expression (fTTj) for A(x, t) 
satisfies ()13|) and ()14p with the initial condition A{0,t) = 1, a. routine 
computation (especially with the use of a computer). The relation- 
ship fll6|) between A{x,t) and B{x,t) is then an immediate conse- 
quence of (jH), which is equivalent to ak{n) = hkiji) — hkiji — 1) . 

It might be of interest, however, to explain how the formula ()17|1 
for A{x,t) can be derived if the answer is not known in advance. If 
we divide equation (fT^ by (dH), then we obtain 

dAe/dx _ Ao 
dAo/dx ~ 'a,' 

Hence ^(^e ~ ^o) = so A\ — Al is independent of x. This obser- 
vation suggests computing the generating function in t for A^ — Al, 
which the computer shows is equal to l + 0{t^) for a large value of A^. 
Assuming then that Al — Al = l (or even proving it combinatorially) , 
we can substitute ^yl — Al for Ao in (fT^ to obtain 

^ = tA^/A^ + Al-l, 
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a single differential equation for Ag. This equation can routinely be 
solved by separation of variables (though some care must be taken 
to choose the correct branch of the resulting integral, including the 
correct sign of ^y — 1); we will spare the reader the details. A 
similar argument yields Ao, so we obtain A = A^. + A^. □ 

Note. Ira Gessel has pointed out the following simplified expres- 
sion for B{x^ t): 



B{x,t) 



2/p 



1-p 



;i8) 



3 Consequences. 

A number of corollaries follow from Theorem 12. HI The first is the 
explicit expressions for ak{n) and bk{n) stated in the introduction. I 
am grateful to Ira Gessel for providing the proof given below. 

Corollary 3.1. For all k,n>l we have 



bk{n) 



- y 



k — s 



n 



2k-i V ^ \(k + r)/2/ \ s 

r+2s<k )l ' ^ 

r=k (mod 2) 



ak{n) = bk{n) - bk^i{n). 
Proof. Define b'j^{n) to be the right-hand side of and set 

B'{x,t)= J^&IH^'^- 



(19) 
(20) 



k,n>0 



Set n = s + m and = r -|- 2s + 2/, so 

^ j^^„^^ , s_2i fr + s + 2l\ fs + m 

r,s,l,m 



B'{x,t)= Y.{-ir2' 



2E 

r,s>0 



r + s + I 

E 



X 



[s + m) 



r + s + 2l\ ft^ 



I 



E 



[rxi 
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The sum on m is e™. Using the formula 

E 

k 

where 



2k + a\ ^ C{uy 



k J VI -4m 



n>0 

the generating function for the Catalan numbers C„ = ;^(^"), we 
find that the sum on I is 

C(t74)''+^ 1 /2 - 2p 



Thus 

^ r,s>0 ^ ^ ^ ^ 



P J, V ^ 

2 1 



Pi 

t 



and the proof of (fT^ follows from (fTHj) . Equation (pn|) is then an 
immediate consequence of (0)). □ 

By Corollary Kllf when A; is fixed bk{n) is a linear combination of 
/c", (/c — 2)", (/c — 4)*^, . . . with coefficients that are polynomials in n. 
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For A; < 6 we have 



62 (n 



-(3"-2n + 3) 
4 

i(4"-2(n-2)2") 



1 



(5" - {2n - 5)3" + 2(^2 - 5n + 5)) 



16 

— (6" - 2{n - 3)4" + {2n^ - I2n + 15)2"). 
32 



As a further apphcation of Theorem 12 .31 we can obtain the factorial 
moment generating function 



F{x,t)= J2 



z/j(n)x" — , 



:,n>0 



J! 



where 



and 



(h)j = hih~l)---{h-J + l). 

Namely, we have 

d^A{x,t) 



dP 



*=1 n>0 ■ fc>0 

= ^z/,(n)a;". 



n>0 



On the other hand, by Taylor's theorem we have 



i>o 



d^A{x,t) 



dP 



it - 



It follows that 



F(x,t) = A{x,t+ 1). 



(21) 
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(Note that it is not at all a priori obvious from the form of A{x, t + 1) 
obtained by substituting t + 1 for t in (|17p that it even has a Taylor 
series expansion at t = 0.) From equations (fT7j) and ^IT\ it is easy 
to compute (using a computer) the generating functions 

Mj{x) = ^z/j.(n)x" 

n>0 

for small j. For 1 < j < 4 we get 



Mi(x) 
M2(x) 

Mi{x) 



6x — 3x^ + x^ 
6(1 -x)2 

90x^ - 15x^ + 6x^ - x^ 
90(1 -s)3 

2520x3 - 315x^ + 189x5 - 231x'' + 93x^ - 18^^ + 2x^ 
1260(1 -x)4 

A^4(a;) 



9450(1 - x) 



where 
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Ni{x) = 47250x^ - 3780x^ + 2880x^ - 2385x^ + 1060x^ - 258x 
+36x" - 3x^2. 

It is not difficult to see that in general Mj{x) is a rational function of 
X with denominator (1 — x)-^^^. It follows from standard properties 
of rational generating functions ^3 §4.3] that for fixed j we have 
that I'jin) is a polynomial in n of degree j for n sufficiently large. In 
particular, we have 

/ N 4n + 1 , , 

Mn) = ^—,n>2 22 
6 

, , 40n2 - 24n - 19 

^ ^ 90 

1120^3 - 2856^2 + 440n+ 1581 
z/'dn) = , n > 6. 
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Note in particular that z^i(n) is just the expectation (mean) of as„. 
The simple formula (4n + l)/6 for this quantity should be contrasted 
with the situation for the length is„(w) of the longest increasing sub- 
sequence of w E &n, where even the asymptotic formula E{n) ~ 
for the expectation is a highly nontrivial result fri\ §3]. A sim- 
ple proof of (j^^ follows from ()27|1 and an argument of Knuth [TIH 
Exer. 5.1.3.15]. 

From the formulas for z/i(n) and z/2(n) we easily compute the vari- 
ance var(as„) of as„, namely, 

32n — 13 

var(as„) = z/2(n) + ui{n) - uiinf = — — — , n > 4. (23) 

ioU 

We now consider a further application of Theorem 12.31 Let 



T„(t) = ^afe(n)t^ 



(24) 



k=0 



For instance, 



Ti(t 
T2it 

Trit 



= t 

= t + f 
= t + 3t^ + 2t^ 
= t + 7t^ + llt^ + 5t^ 
= t 



15t2 + 43t^ + 45t^ + 16t^ 
= t + 31t^ + 148t^ + 268t^ + 211t^ + 61t^ 
= t + 63t^ + 480t^ + 1344t^ + 1767t^ + 1113t^ + 272t^. 



Corollary 3.2. The polynomial Tn{t) is divisible by (1 +t)'-"'/^-l. 
Moreover, zf Unit) = T„(t)/(H- t)L"/2j ^ th^n 

t/2n(-l) = -t/2n+l(-l) = 

where E2n+i denotes a tangent number. 



'2n+l 
2n ' 
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Proof. Let Ae(x, t) and Ao{x, t) be the even and odd parts of t) 
as in equation (jl(J|) . By the definition of Ae(x) we have 



T2n(t) X 



2n 



+ (2n)!' 



n>0 

With the help of the computer we compute that 
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hm Af,{x/y/T+t,t) = sech 

^ 2" (2n)!' 

n>0 ^ ^ 

Hence the desired result is true for T2„(t). Similarly, 

lim Vl + tAo{x/Vl + t,t) = -A/2tanh^ 

1/2 

^ 2" (2n + l)V 

n>0 ^ ^ 

proving the result for T2„+i(t). □ 

By Corollarv 13.21 we have Tn,(— 1) = for > 2. In other words, 
for > 2 we have 

G ©n : as„(w;) even} = #{w G 6^ : as„(w) odd} = —. 

A simple combinatorial proof of this fact follows from switching the 
last two elements of w; it is easy to see that this operation either 
increases or decreases aSn{w) by 1, as first pointed out by M. Bona 
and P. Pylyavskyy. More generally, a combinatorial proof of Corol- 
lary ()3.2j) is a consequence of equation (j?fjl below and an argument 
of Bona [HI Lemma 1.40]. 

The formulas ()22|) and ()23|) for the mean and variance of QiSfi SU. ggest 
in analogy with that as„ will have a limiting distribution K{t) 
defined by 

^ , / as„(iy) — 2n/3 
K{t) = lim Prob ^ ' — < t 
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for all t G M, where w is chosen uniformly from (3„. Indeed, we have 
that K{t) is a Gaussian distribution with variance 8/45: 

K{t) = — / e-' ds. (25) 

It was pointed out by Pemantle (private communication) that equa- 
tion (|^ is a consequence of the result [13 Thms. 3.1, 3.3, or 3.5] and 
possibly also |3] . An independent proof was also given by Widom [TH] , 
and in the next section we explain an additional method of proof. 



4 Relationship to alternating runs. 

A run of a permutation w = ai ■ ■ ■ € (5„ is a maximal factor 
(subsequence of consecutive elements) which is increasing. An al- 
ternating run is a maximal factor that is increasing or decreasing. 
(Perhaps "birun" would be a better term.) For instance, the permu- 
tation 64283157 has four alternating runs, viz., 642, 28, 831, and 157. 
Let gk{n) be the number of permutations w G ©n with k alternating 
runs. It is easy to pointed out by Bona [7j, that 

O'kin) = ^{gk-i{n) + gk{n)), n>2. (26) 

If we define G'„(t) = Ylik9k{n)t^^ then equation is equivalent to 
the formula 

T.(t) = ^(l + t)G'„(t), (27) 

where T„(t) is defined by (j2H). 

Research on the numbers gkin) go back to the nineteenth century; 
for references see Bona P[ §1.2] and Knuth fOJ Exer. 5.1.3.15-16]. 
In particular, let Anit) denote the nth. Eulerian polynomial, i.e., 

where des(w) denotes the number of descents of w (the size of the 
descent set defined in equation (j2Hl))- It was shown by David and 
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Barton jHl pp. 157-162] and stated more concisely by Knuth (TUl 
p. 605] that 

G„(t)= (l + ^rM„(i^), n>2, 

where w = ^ j^. Theorem 12. 31 is then a straightforward consequence 
of the well-known generating function (e.g., ^ Thm. 1.7]) 

E . , X 1 t 

n>0 

It is also well-known (e.g., [HI Thm. 1.10]) that the Eulerian poly- 
nomial An{t) has only real zeros, and that the zeros of An{t) and 
A„_|_i(t) interlace. From this fact Wilf |i20j showed that the poly- 
nomials Gn{t) have (interlacing) real zeros, and hence by (jTfj) the 
polynomials T„(t) also have real zeros. It is then a consequence of 
standard results (e.g., [H Thm. 2]) that the numbers ak{n) for fixed 
n are asymptotically normal as n — > oo, yielding another proof of 
(123). 



5 Open problems. 

In this section we mention three directions of possible generalization 
of our work above. 

1. Let is{m,w) denote the length of the longest subsequence of 
w G &n that is a union of m increasing subsequences, so 
is(w) = is(l,w). The numbers is{m,w) have many interest- 
ing properties, summarized in fr7\ §4]. Can anything be said 
about the analogue for alternating sequences, i.e., the length 
as(m, w) of the longest subsequence of w that is a union of m 
alternating subsequences? This question can also be formulated 
in terms of the lengths of the alternating runs of w. 

2. Can the results for increasing subsequences and alternating sub- 
sequences be generalized to other "patterns"? More specifi- 
cally, let cr be a (finite) word in the letters U and D, e.g.. 
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cr = UUDUD. Let 0"°° denote the infinite word acxa • ■ • , e.g., 

(UUD)'^ = UUDUUDUUD ■■■ . 

For this example, we have for instance that UUDUUDU is a 
prefix of (T°° of length 7. 

Let T = aia2 ■ ■ ■ dm-i be a word of length m — 1 in the letters 
U and D. A sequence v = viV2---Vm of integers is said to 
have descent word r if f j > fj+i whenever ai = D, and Vi < 
fj+i whenever = U. Thus f is increasing if and only if 
r = f/'"~^, and is alternating if and only if r = {DUy~^ or 
r = {DUy^^D depending on whether m = 2j — 1 or m = 2j. 

Now let w G &n and define leno.(w) to be the length of longest 
subsequence of w whose descent word is a prefix of a°°. Thus 
len[/(w) = isn{w) and \en£)ij{w) = as„(w). What can be said 
in general about leno.(w)? In particular, let 

Ea{n) = ^ len^(w), 
toe©„ 

the expectation of\eia„{w) for w G (5„. Note that Eu{n) ~ 2A/n 
by CQ), and Edu^u) ~ 2n/3 by ((Tj). Is it true that for any a we 
have E„{n) ~ an'^ for some a, c > 0? Or at least that for some 
c > (depending on a) we have 

logE^(n) 
lim — = c, 

n^oo log n 

in which case can we determine c explicitly? 
3. The descent set D{w) of a permutation w = Wi ■ ■ ■ w„ is defined 

by 

D{w) = {i : Wi> Wi+i] C [n - 1], (28) 

where [jt- — 1] = {1, 2, . . . , n — 1}. Thus w is alternating if and 
only if D{w) = {1, 3, 5, . . . } n [n - 1]. Let 5 C [fc - 1]. What 
can be said about the number hk^s{f^) of permutations w G &n 
that avoid all f G satisfying D{v) = S7 In particular. 
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what is the value 5 = hm„_»oo &fc,s(^)^^"? (It follows from [2] 
and ^21; generalized in an obvious way, that this limit exists 
and is finite.) For instance, if 5* = or 5* = [A; — 1], then it 
follows from [13] that Lk^s = {k — 1)^. On the other hand, 
if 5 = {1, 3, 5, . . . } n [fc '- 1] then it follows from ^ that 
Lk,s = k-l. 
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